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A stochastic pump is a Markov model of a mesoscopic system evolving under the control of 
externally varied parameters. In the model, the system makes random transitions among a 
network of states. For such models, a "no-pumping theorem" has been obtained, which iden- 
tifies minimal conditions for generating directed motion or currents. We provide a derivation 
of this result using a simple graphical construction on the network of states. 
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I. INTRODUCTION 

The term "molecular motors" refers to subcellular molecular complexes that perform biologi- 
cally important tasks such as carrying loads in intracellular transport, contracting muscle cells and 
polymerizing microtubules [H[2]- Because of their small size, molecular motors are strongly influ- 
enced by the thermal fluctuations of the surrounding medium, and thus exhibit highly stochastic 
behavior. In recent years there has been considerable and growing interest in synthesizing artificial 
analogues of these molecular motors. Achievements to date include molecular walkers on a DNA 
origami track [3HS], rotating catenanes [6j, nanoscale assembly lines [7j, and single-molecule electric 
motors [8]. 

Unlike their biological counterparts, artificial molecular machines are generally non-autonomous: 
they are manipulated by varying external parameters or stimuli such as temperature, chemical 
environment, or laser light. In view of this it becomes interesting to investigate, from a general 
theoretical perspective, how a small system evolving in a thermal environment can be controlled 
by means of externally driven parameters. In this context the term "stochastic pump" has come 
to denote a model class of systems (specified more precisely in Section [TT] below) whose dynamics 
are characterized by random transitions among a discrete set of states, as the transition rates 
themselves are varied externally. Stochastic pumps capture essential features of non-autonomous 
molecular machines while remaining amenable to exact mathematical analysis. 

Experiments by Leigh and coworkers [6] on catenanes - mechanically interlocked, ring- like 
molecules - provide a paradigm of non-autonomous, artificial molecular machines that can be 
modeled as stochastic pumps |9Hllj. In these experiments, one or two small rings make transitions 
among a set of binding sites on a large ring. These transitions can be treated as a Poisson process, 
as in Sec. [TT| below. By using laser light and changes in temperature to perturb the conformations 
of these binding sites, the transition rates can be manipulated in a time-dependent manner. 

The study of stochastic pumps focuses on the flow of probability that arises in response to 
the time-dependent pumping of the external parameters. In the specific example of the catenane 
experiments of Ref. [6] , this flow of probability describes the statistics of the motion of the small 
ring (or rings) from one binding site to another on the large ring. For the case of adiabatic 
(quasi-static) pumping, the generation of such probability currents can be understood in terms 
of geometric phases [9j [TT1113] . analogous to Berry's phase in quantum mechanics [14j . For the 
more general case of non-adiabatic stochastic pumps, a "no-pumping theorem" has been obtained, 
specifying conditions under which the time-periodic driving of a stochastic pump leads to no net 
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flow of probability |X0|, [T5l - I17| . This result will be the main focus of this paper. 

Rahav et al [10] derived the no-pumping theorem by analyzing properties of matrices, and 
Chernyak and Sinitsyn |15j showed that this result follows from a quite general "pumping restriction 
theorem" related to the topology of the stochastic pump. Horowitz and Jarzynski [16] extended 
the result to one-dimensional Brownian models. More recently, Maes et al |17j have obtained and 
extended the no-pumping theorem by considering the embedded Markov chain associated with the 
stochastic pump. The aim of the present paper is to provide a quick derivation of the no-pumping 
theorem using an elementary graph theoretic construction. We first give an introduction to our 
mathematical set up and a brief statement of the no-pumping theorem (Sec. II), then we illustrate 
our derivation with a simple example (Sec. Ill) and finally we give the general proof (Sec. IV). 



Consider a system whose evolution is modeled by random jumps among a set of N states. 
Specifically, we will model these jumps as a Poisson process: if the system is in state j G {1, . . . , ./V}, 
its rate of jump to some other state i is given by a real number R^j > 0. We assume Rji ^ if 
Rij 7^ 0, but the two rates need not be equal. It is convenient to represent these states and jumps 
by a graph G with N vertices and E edges. Each vertex represents one state, and each edge 
indicates positive transition rates between the pair of vertices it connects (Rij, Rji > 0). Thus the 
dynamics are fully specified by 2E positive transition rates Rij (i ^ j). This is illustrated in Fig. [T] 
for a system with N = 4 states and E = 4 edges. We assume G to be connected, in the sense that 
any vertex can be reached from any other by following some sequence of edges. Let us also define 
a cycle of a graph to be an ordered set of more than two vertices, with edges between consecutive 
elements, and between the first and last elements. Thus a cycle can be pictured as a closed loop 
formed by a sequence of edges in the graph. There is one such cycle {2, 3, 4} in Fig. [T] 

Let Pi(t) denote the probability to find the system in state i at time t. The instantaneous 
probability current from state j to state i, denoted by J%j(t), is then given by 



II. SETUP 



Jij(t) = RijPj(t) - RjiPi(t) 



(1) 



which is anti-symmetric with respect to exchange of indices: 




(2) 



The rate of change of the probability to find the system in any state i is the net current into that 
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FIG. 1. Graphical representation of a 4 state system with a single cycle {2,3,4}. 

state: 

For the system in Fig. [I] these are explicitly written down in equation ([9]). 

For a system that satisfies the above assumptions let us first consider the case of fixed transition 
rates Rij. The state probabilities are then described by a vector p(t) = (pi, ■ ■ ■ ,pn) that evolves 
asymptotically toward a unique steady-state distribution p s \18\ I19j . The transition rates {Rij} 
are said to satisfy detailed balance if Jfj = RijPj — RjiP\ = for every pair that is, if all 

probability currents vanish in the steady state. In this scenario, the non-zero transition rates can 
be written in the form 

R 4j = e -( B «- s i) (4) 

with (crucially) 

Bij = Bji (5) 

for all Specifically, if we let Ei = — lnpf denote the "stochastic potential" of state i [20| [2T| . 

then the condition for detailed balance becomes Rije~ E i = Rjie~ Ei . Comparing with equation 
Q, we see that this condition is equivalent to the symmetry = Bji (equation Q). Because 
of the evident similarity between equation Q and the familiar Arrhenius expression for thermally 
activated transitions [9], we will interpret the E{S as the effective free energies of the iV states and 
the -Bjj's as effective free energy barriers between them. 

Let us now move on to the case of time-dependent transition rates Rij(t), and let us henceforth 
assume that these rates satisfy detailed balance at all times. (In other words, if we were to "freeze" 
the rates at their values at any instant in time, then the system would subsequently relax to a 
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steady state with zero currents, Jfj = for all i, j.) We can then interpret these time-dependent 
rates as arising due to state and barrier energies that vary with time, {Ei(t)} and {B{j(t)}. If 
these variations are periodic in time, say with period T, then according to Floquet theory |22| . the 
system response also becomes periodic in the limit of long time: pi(t + T) = Pi(t). We will call this 
the periodic steady state and will denote the corresponding quantities by a superscript ps. 

We denote by <i^J the integrated probability current from state j to state i over a time period 
T in periodic steady state, i.e. 

*% = J T *tJ%{t). (6) 
From equation ^ these are also antisymmetric: 

= -*?. (7) 

These integrated currents are the objects of our interest, as they reveal whether or not the periodic 
pumping of the state and barrier energies produces a directed flow of probability throughout the 
network of states. If ^ for some then this indicates a net flow of probability, over each 

period of pumping, along the edge connecting states i and j. Conversely, if = for every edge 
in the graph, then the probability currents Jfj(t) might slosh back and forth, so to speak, but 
there is no net circulation of current. 

In the context of the catenane experiments mentioned earlier [6] , the directed flow of probability 
is manifested in the unidirectional rotation of the small ring(s) around the large ring. Indeed, the 
experimentally observed absence of unidirectional rotation in the case of [2]-catenanes (one small 
ring interlocked with one large ring) is an instance of the no-pumping theorem, which we now state 
explicitly. 

With the above definitions and assumptions in place, the no-pumping theorem asserts that if 
either all the state energies {E{\ or all the barrier energies {Bij} are kept fixed in time during the 
pumping, then the integrated probability current is zero along all edges, i.e. 

= for all pairs (8) 

Consequently one must vary at least one state energy and at least one barrier energy to produce 
directed probability currents in the periodic steady state. 

The case of fixed state energies {Ei} and time-dependent barriers {Bij(t)} is straightforward: 
the system asymptotically approaches a fixed steady-state distribution pf = exp (—Ei) |10| . Equa- 
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tions 0, Q and Q then imply 

= e -[B«(*)-B,] e -^ _ e -[Bji(t)-Bi] e -Bi 

= g~ BijW _ e ~ B ji( t ) = 

for all (i, j). Thus the instantaneous currents vanish, and therefore so do the integrated currents. 
Hence in the following sections we focus on the less obvious case of fixed barrier energies {-By}, 
but periodically pumped state energies, 



III. ILLUSTRATION OF PROOF 

Consider the system in Fig. [TJ with N = 4 states, E = A edges and a single cycle, and assume 
that all the B«'s are fixed in time while one or more of the £Ij(t)'s are varied periodically. 
Combining equation Q with the antisymmetry of Jf/'s, equation Q, we have 

Pi = Ju(t) 

P2 = -Jnit) + J2s{t) - J 42 (t) 

(9) 

P3 = -J23(t) + J 34 {t) 
PA = J&it) ~ Jte(t). 

In the periodic steady state there is no net change in state probabilities over a time period T, i.e. 
f T Pi(t) dt = for all i, hence 



(10) 

o = -*£ + C 

= *S - ^4 

where we have integrated equation ^ over one period of the periodic steady state. Since normal- 
ization implies ^^Pi = 0, only 3 of the 4 equations in either Q of (10) are independent. The 



solution of equation ( 10 ) therefore contains a single free parameter: 

*S = , = = = (11) 

These results are easy to understand: = because the edge (1,2) does not belong to any 
cycle, and the currents along the remaining edges are equal because they all belong to the same 
cycle, which is the only cycle in the graph. This intuition has been formalized and generalized to 
arbitrary graphs by Chernyak et al jl5j. 



7 



Detailed balance implies further constraints. Prom equations ([!]) and Q we have 

Jy(t) e B ^ = e E ^ Pj (t) - e E ^ Pi {t). 
Summing both sides of this equation over the edges along the cycle {2, 3, 4} then gives 

Mt) e B ™ + J M (t) e B ^ + J A2 (t) e B ^ = 0. (12) 
We have deliberately omitted the superscript ps to indicate that the above relation holds whether 



or not the system has reached the periodic steady state. Indeed, equation ( 12 ) remains true even 
if the external driving is not periodic, and even if the barriers are time-dependent. We note that a 
generalized form of this equation for arbitrary graphs was used by Chernyak and Sinitsyn to derive 
a "pumping-quantization theorem" for integrated probability currents: in the low-temperature, 
adiabatic limit, each integrated current is expressed in terms of a vector potential in the space of 
externally controlled parameters, and exhibits quantized behavior |llj . 

Returning to the periodic steady state with fixed barriers {Bij}, we integrate equation (12) over 
one period T to get 

m e B ™ + m e B ^ + $g e B42 = 0. (13) 



Combined with equation (11) this gives 

$ (e B23 + e Ba4 + e B24 ) = 0. 



Hence $ = 0, and all the integrated probability currents 's in the system are zero. 

IV. GENERAL PROOF 

Consider a connected graph G with N vertices and E edges. As before, we assume that the 
2E transition rates satisfy detailed balance at all times, hence they can be written in the form 
Rij = e c ~( Bi i~ E '' i with = Bji. We now imagine that the state energies Ei(t) are varied 
periodically with time, while the barriers energies B^ are held fixed. After the system has reached 
a periodic steady state, p(t + T) = p(t), integration of equation ([3| over one period yields 

J2^j=° for alii (14) 

3+i 



As with equation (10) only (iV — 1) of these iV equations are independent. Moreover, equation (14) 



implies that if <3?^ s > for a connected pair of states then there must exist at least one other 



s 



vertex k such that <fr?f < 0, as the flow of probability into state i must be balanced by the flow of 
probability out of that state. 

As in our illustration, detailed balance implies further constraints. Summing over, and then 
integrating with time, the instantaneous currents along the edges of any cycle c = {ii, . . . , im} we 



get (compare with equation (13)) 



M 

E (I> '';V ' " - w^i- as) 

3=1 



This implies that if one edge of c has ^ s i +1 > then there must exist at least one other 

edge (ik, ik+i) in c with &^ ik+1 < 0. Thus, for any cycle, the non-zero i 's cannot all have the 



same sign. We now prove that (14) and (15) jointly imply = for all edges. We establish this 
below by contradiction, assuming the existence of at least one edge (to, n) with &mn > 0. 

To formulate our argument, let us introduce the following convenient construction on G. Along 
every edge, say (r, s), with non-zero <J>rs, we draw an arrowhead indicating the positive direction 



of the integrated probability current, as shown in Fig. 2(a) By assumption, G contains at least 



one arrow, pointing from n to m. Equation (14) then implies the existence of another edge (p,m), 
such that <3?mp < 0, or equivalently, > 0. Thus we must have another arrow pointing from m 
to some p 7^ n. Similarly there must be another arrow from some vertex q ^ to to n, to prevent 
the depletion of probability from state n. Refer to Fig. 2(a)| for illustration. 



Consider now the set T> of all vertices that can be reached from to by following the arrows. 
In Fig. |2(a) T> = {p,r,. . .}. Consider also set S of all vertices from which n can be reached 



by following the arrows. In Fig. 2(b)| S = {q, u, ...}. These two sets must have at least one 



element in common, otherwise there will be a constant drainage of probability from S to T> which 
is inconsistent with a periodic steady state. Let v denote this common element. 

The existence of a common element has an interesting consequence. Starting from state m, we 
can reach state v by following the arrows (since v E T>), and from there we can reach state n by 
continuing to follow arrows (since v € S). Since an arrow points from n to m, we conclude that 
there exists a cycle {m, .., v, .., n} consisting of edges with arrows all pointing in the same direction 
{to — > .. — > v — > .. — > n — > to}. By construction, the ^ > fjj j+1 's along this cycle are all positive. One 



such cycle {m,p,q,n} is shown in Fig. 2(b) 



However, this contradicts equation (15). We conclude that the existence of a non-zero $mn is 



inconsistent with our starting assumptions, and this completes our proof. 



(a) Illustration of the construction of arrows. An arrow pointing along an edge, e.g. from n to m, 
indicates a positive integrated probability current from n to m, $mn > 0. 





(b) One of the possible cycles, {m,p,q,n}, with all arrows pointing the same way. 
FIG. 2. Part of an N state graph with arbitrary topology. 

V. CONCLUSION 

Recent interest and experimental progress in the synthesis of artificial molecular machines (see 
e.g. Refs. [3HZ]) have stimulated basic theoretical work on the control of stochastic systems by 
the variation of external parameters [91413} [T5rll7j . Among the results that have been obtained is 
the no-pumping theorem stated in Section [TTJ which specifies minimal requirements for generating 
directed motion in periodically driven stochastic pumps. In this paper we have presented a simple 
proof of this theorem, based on the idea that if a non-zero integrated current is generated along 
some edge of the graph, then this edge must be part of a closed loop along which probability 
is conveyed in one direction: all the 3q^. +1 's along the cycle have the same sign. This in turn 
is inconsistent with the assumption of detailed balance with fixed energy barriers (which gives 



equation (15)). 

Very recently, Ren et al [23J have shown that when the network itself is a single cycle, the 
no-pumping theorem follows from a duality between state and barrier energies. Such a duality was 
previously noted by Jack and Sollich [23] for infinite one-dimensional lattice models. It would be 
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interesting to see whether this duality can be extended to more complicated network topologies. 



ACKNOWLEDGMENTS 

We gratefully acknowledge useful discussions with Debasis Mandal, Suriyanarayanan Vaikun- 
tanathan and Jordan Horowitz, and financial support from the National Science Foundation (USA) 
under grants ECCS-0925365 and DMR-0906601, and the University of Maryland, College Park. 



[1] J. Howard, Mechanics of Motor Proteins and the Cytoskeleton (Sinauer, Sunderland, 2001). 

[2] A. O. Sperry, ed., Molecular Motors: Methods and Protocols, Methods in Molecular Biology, Vol. 392 
(Humana Press, 2007). 

[3] R. Pei, S. K. Taylor, D. Stefanovic, S. Rudchenko, T. E. Mitchell, and M. N. Stojanovic, J. Am. Chem. 
Soc., 128, 12693 (2006). 

[4] K. Lund, A. J. Manzo, N. Dabby, N. Michelotti, A. Johnson-Buck, J. Nangreave, S. Taylor, R. Pei, 

M. N. Stojanovic, N. G. Walter, E. Winfree, and H. Yan, Nature, 465, 206 (2010). 

[5] F. C. Simmel, ChemPhysChem, 10, 2593 (2009). 

[6] D. A. Leigh, J. K. Y. Wong, F. Dehez, and F. Zerbetto, Nature, 424, 174 (2003). 

[7] H. Gu, J. Chao, S.-J. Xiao, and N. C. Seeman, Nature, 465, 202 (2010). 

[8] H. L. Tierney, C. J. Murphy, A. D. Jewell, A. E. Baber, E. V. Iski, H. Y. Khodaverian, A. F. McGuire, 
N. Klebanov, and E. C. H. Sykes, Nature Nanotechnology (2011). 

[9] R. D. Astumian, Proc. Natl. Acad. ScL, 104, 19715 (2007). 

[10] S. Rahav, J. Horowitz, and C. Jarzynski, Phys. Rev. Lett., 101, 140602 (2008). 

[11] V. Y. Chernyak and N. A. Sinitsyn, J. Chem. Phys., 131, 181101 (2009). 

[12] N. A. Sinitsyn and I. Ncmenman, Phys. Rev. Lett., 99, 220408 (2007). 

[13] N. A. Sinitsyn, J. Phys. A: Math. Theor., 42, 193001 (2009). 

[14] M. V. Berry, Proc. R. Soc. Lond. A, 392, 45 (1984). 

[15] V. Y. Chernyak and N. A. Sinitsyn, Phys. Rev. Lett., 101, 160601 (2008). 

[16] J. M. Horowitz and C. Jarzynski, J. Stat. Phys., 136, 917 (2009). 

[17] C. Maes, K. Netocny, and S. R. Thomas, J. Chem. Phys., 132, 234116 (2010). 

[18] J. Schnakenberg, Rev. Mod. Phys., 48, 571 (1976). 

[19] N. G. van Kampen, Stochastic Processes in Physics and Chemistry (Elsevier, New York, 2007). 

[20] H. Ge and H. Qian, Phys Rev E, 81, 051133 (2010). 

[21] R. Kubo, K. Matsuo, and K. Kitahara, |J. Stat. Phys., 9, 51 (1973)] 

[22] P. Talkner, New J. Phys., 1, 4 (1999). 



11 



[23] J. Ren, V. Y. Chernyak, and N. A. Sinitsyn, Journal of Statistical Mechanics: Theory and Experiment, 
5, 05011 (2011). 

[24] R. L. Jack and P. Sollich, Journal of Statistical Mechanics: Theory and Experiment, 11, 11011 (2009). 



